Appendix. Proof of Theorem 1. Define. [ ˆΛ 0(D) ˆΛ 0(t) ˆΛ (t) ˆΛ. (0) t. X 0 n(t) = D t. and. 0(t) ˆΛ 0(0) g(t(d t)), 0 < t < D, t.

Size: px
Start display at page:

Download "Appendix. Proof of Theorem 1. Define. [ ˆΛ 0(D) ˆΛ 0(t) ˆΛ (t) ˆΛ. (0) t. X 0 n(t) = D t. and. 0(t) ˆΛ 0(0) g(t(d t)), 0 < t < D, t."

Transcription

1 Appendix Proof of Theorem. Define [ ˆΛ (D) X n (t) = ˆΛ (t) D t ˆΛ (t) ˆΛ () g(t(d t)), t < t < D X n(t) = [ ˆΛ (D) ˆΛ (t) D t ˆΛ (t) ˆΛ () g(t(d t)), < t < D, t where ˆΛ (t) = log[exp( ˆΛ(t)) + ˆp/ˆp, ˆΛ(t) is the Nelson-Aalen estimator of Λ(t) defined in (3.8), ˆp is defined in (3.), ˆΛ (t) = log[exp( ˆΛ(t)) + p/p. Note that Λ () = ˆΛ () = Λ() =. Then X(t) = t q (D t) q tλ (D) DΛ (t). For any given small ε >, let c (,minx(τ) X(τ ε),x(τ) X(τ +ε)), which depends on ε,τ,τ 2,θ q. Then X(τ) X(t) > c whenever t τ > ε. Noticing that X n (t) attains its maximum at ˆτ n, for sufficiently large n, we have Pr ˆτ n τ > ε PrX(τ) X(ˆτ n ) > c PrX(τ) X(ˆτ n ) + X n (ˆτ n ) X n (τ) > c Pr X n (ˆτ n ) X(ˆτ n ) + X n (τ n ) X(τ) > c Pr sup X n (t) X(t) > c τ <t<τ 2 2 Pr sup X n (t) Xn (t) > c + Pr sup Xn τ <t<τ 2 (t) X(t) > c τ <t<τ 2 Pr Dτ p (D τ 2 ) p sup Ũn(t) +τ p 2 (D τ 2) p Ũn(D) > c τ <t<τ 2 + Pr sup X n (t) Xn(t) > c, (A.) τ <t<τ 2 where U n(t) = ˆΛ (t) Λ (t). Consequently, there exist c 2 > c 3 >, depending on c,τ,τ 2,D q, such that Pr ˆτ n τ > ε Pr sup Un (t) > c 2 + Pr Un (D) > c 3 τ <t<τ 2 + Pr sup X n (t) Xn(t) > c τ <t<τ 2 = I + II + III. (A.2)

2 From the definition of Λ (t) we find that Un(t) = [ log exp( ˆΛ(t)) + p log p = exp( η(t)) exp( η(t)) + p ˆΛ(t) Λ(t), p [exp( Λ(t)) + p (A.3) where η(t) is a number between ˆΛ(t) Λ(t). Thus exp( η(t)) lies on the segment between Ŝ(t) = ˆF n (t) S(t) = F(t) = pf (t). Under the i.i.d. censoring model, according to Wang (987), sup t [,τf ˆF n (t) F(t) almost surely for τ F τ G. Thus for any α < pf (D) sufficiently large n, exp( η(t)) > [ F(D) α = [ pf (D) α = φ(d) provided that τ F > D. It follows from (A.3) that U n(t) φ(d) + p ˆΛ(t) Λ(t) = φ(d) + p U n(t), where U n (t) = ˆΛ(t) Λ(t) is a martingale. By (A.2) (A.3) there exists c > depending on c,c 2,τ,τ 2,D, q, p F, such that We know that I Pr sup U n (t) > c,τ 2 Y (n) + PrY (n) < τ 2 τ <t<τ 2 n Pr sup U n (t Y (n) ) > c + PrY i < τ 2 τ <t<τ 2 i= [ 2 c 2 E sup U n (t Y (n) ) + (PrY < τ 2 ) 2. (A.) τ <t<τ 2 ˆΛ(t Y (n) ) Λ(t Y (n) ) = t Y(n) is a mean zero, square integrable martingale, E[ˆΛ(t Y (n) ) Λ(t Y (n) ) 2 = E t Y(n) n H i (s) dm n (s) (A.5) i= n H i (s) λ(s)ds, (A.6) where M n (t) = n i= N i(t) t n i= H i(s)λ(s)ds is the basic martingale. 2 i=

3 In view of (A.5) (A.6) the martingale inequality (Hall Heyde, 98, p.5), the first term on the right h side of (A.), denoted by I, satisfies I 2c 2 E[U n(τ 2 Y (n) ) 2 = 2c 2 E τ2 Y (n) I(s Y (n) )H n (s)λ(s)ds. Thus I converges to zero as n since τ 2 Y (n) H n (s)λ(s)ds almost surely. Next, by (A.2), II Pr U n (D) > c 3,D Y (n) + PrY (n) < D. Similarly, II converges to zero as n. In order to prove III, we rewrite X n (t) X n(t) as X n (t) = t q (D t) t[ˆλ q (D) ˆΛ (t) (D t)ˆλ (t) (A.7) Xn (t) = tq (D t) t [ˆΛ q (D) ˆΛ (t) (D t)ˆλ (t). (A.8) By (A.), (A.7) (A.8), III Pr sup X n (t) Xn(t) > c τ <t<τ 2,D < Y (n) + PrY (n) D Pr 2 sup ˆΛ (t) ˆΛ (t) τ q 2 (D τ 2) q > c <t<d 8 + Pr sup ˆΛ (t) Λ (t) τ q 2 (D τ 2 ) q > c + PrY D n τ <t<τ 2 8 = I 2 + I 3 + (PrY D) n, say. It is easy to see that I 2 Pr log ˆp logp + sup <t<d log exp( ˆΛ(t)) + ˆp exp( ˆΛ(t)) + p > c. (A.9) 8 Since ˆp converges to p in probability under conditions of Maller Zhou (996, p.67), logx is a continuous function for x >, sup <t<d ˆΛ(t) Λ(t) almost surely (cf. Anderson et al., 993, p.93), (A.9) shows that I 2 converges to zero as n. Similarly, I 3 as n. This completes the proof of Theorem. In order to show the asymptotic properties in Section, we need some Lemmas. We first state some conditions from Hu (998), which correspond to Conditions of 3,,, 2, 5 of Huang (996), respectively. Note that o p () in the following representations 3

4 indicates convergence to zero in outer probability in case that the term involved is not Borel measurable. Condition. (Stochastic Equicontinuity Condition) n(p n P ) l µ (ˆµ, ˆν) n(p n P ) l µ (µ,ν ) + n ˆµ µ = o p (), where ˆµ µ = o p () ˆν ν = o p (). Condition 2. np n lµ (µ,ν ) = O p (). For i.i.d. observations, Condition 2 holds automatically if P l2 µ (µ,ν ) < by the central limit theorem. Condition 3. (Smoothness Condition) For (µ,ν) D n, P lµ (µ,ν) P lµ (µ,ν ) P lµµ (µ,ν )(µ µ ) P lµν (µ,ν )(ν ν ) = o( µ µ ) + o( ν ν ), where D n = (µ,ν) : µ µ η n, ν ν cn /2 for some constant c. Condition. np lµν (µ,ν ) ˆν ν = O p (). When ˆν is a n-consistent, this condition holds automatically. Condition 5. under the true probability P, [ (Pn P ) l µ (µ,ν ) d n Λ = ˆν ν [ Λ where Λ N (,Σ) with Σ being a positive definite matrix. Λ 2, (A.) The following Lemmas are due to Hu (998), which also correspond to Theorem 6. in Huang (996) for the semiparametric model with a infinite-dimensional parameter space. Lemma. (Consistency) Suppose that µ is the unique solution to P lµ (µ,ν ) = ˆν is an estimator of ν such that ˆν ν = o p (). If P n lµ (µ,ν) P lµ (µ,ν ) sup µ Θ, ν ν η n + P n lµ (µ,ν) + P lµ (µ,ν ) = o p () for every sequence η n, then the ˆµ almost surely solving P n lµ (ˆµ, ˆν) = o p () converges in outer probability to µ.

5 Proof. See Theorem 3.. of Hu (998). Lemma 2. Suppose that the class of functions ψ(µ,ν) : µ µ < γ, ν ν < γ is P -Donsker for some γ >, that P ψ(µ,ν X) ψ(µ,ν X) 2, as µ µ ν ν. If ˆµ p µ ˆν ν p, then n(p n P )(ψ(ˆµ, ˆν) ψ(µ,ν )) = o p (). Proof. See Lemma 3.. of Hu (998). We should note that the conditions of Lemma 2 imply Condition. But they give a set of simple sufficient conditions for Condition, so we will verify the conditions of Lemma 2 in the proof of Theorem below. Lemma 3. (Rate of Convergence) Suppose that ˆµ satisfies P n lµ (ˆµ, ˆν) = o p (n /2 ) is a consistent estimator of µ, which is the unique point for which P lµ (µ,ν ) =, ˆν is an estimator of ν satisfying ˆν ν = O p (n /2 ). Then under Conditions -, n(ˆµ µ ) = O p (). Proof. See Theorem 3..3 of Hu (998). Lemma. (Normality) Suppose that µ is the unique solution to P lµ (µ,ν ) = ˆν is an estimator of ν satisfying ˆν ν = O p (). Then under Conditions 3-5, n(ˆµ µ ) d ( P lµµ (µ,ν )) N (,V ), where V = V ar(λ + P lµν (µ,ν )Λ 2 ). Proof. See Corollary 3..2 of Hu (998). Lemma 5. For l β (µ,ν X) l θ (µ,ν X)defined in (.3) (.), if µ µ η n ν ν cn /2, then P l µ (µ,ν)) l µ (µ,ν )) 2 = o p (). Proof. We only show that P l β (µ,ν)) l β (µ,ν )) 2 = o p (), when µ µ η n ν ν cn /2, as the proof for l θ is similar. Denote A(µ,ν,y) = ( δ)( p)y p + pexp( βy)) B(µ,ν,y) = δθ β(β + θ) + ( δ)( p)y p + pexp( βy θ(y τ)). 5

6 Then l β (µ,ν)) l β (µ,ν )) = [A(µ,ν,y)I(y τ) A(µ,ν,y)I(y τ ) Thus it suffices to show + [B(µ,ν,y)I(y > τ) B(µ,ν,y)I(y > τ ) + [δ/β δ/β. P A(µ,ν,y)I(y τ) A(µ,ν,y)I(y τ ) 2 = o p () P B(µ,ν,y)I(y > τ) B(µ,ν,y)I(y > τ ) 2 = o p (). (A.) (A.2) Note that A(µ,ν,y) is continuous for (µ,ν) C C η, A(µ,ν,y)I(y τ) A(µ,ν,y)I(y τ ) 2 = [A(µ,ν,y)I(y τ) A(µ,ν,y)I(y τ ) + [A(µ,ν,y)I(y τ ) A(µ,ν,y)I(y τ ) 2 = A 2 (µ,ν,y)i 2 (τ < y τ) + [A(µ,ν,y) A(µ,ν,y) 2 I 2 (y τ ), P (I 2 (τ < y τ)) = p[f (τ) F (τ ) as τ τ. Thus (A.) is proved. The proof of (A.2) is similar. Proof of Theorem 2. To prove the consistency of the pseudo estimator ˆµ, we mainly need sup µ C, ν ν η n P n lµ (µ,ν) P lµ (µ,ν ) = o p () for every sequence η n. Then the consistency of ˆµ follows from Lemma. Since P n lµ (µ,ν) P lµ (µ,ν ) (P n P ) l µ (µ,ν) + P ( l µ (µ,ν) l µ (µ,ν )), by (.) the second term obviously tends to zero when ν ν η n, it suffices to show that the class of functions F η l µ (µ,ν) : µ C R 2, ν ν η is a VC-class for some η >, where C is defined in (.). This implies that the uniform strong law of large numbers holds, i.e., sup f Fη (P n P )f p (see Van der Vaart Wellner, 996, Chap , for details). Let F η = I (,τ (y) : τ τ η. Then the VC-index of the class of functions F η is 2 by Example 2.6. of Van der Vaart Wellner (996). Thus the class of functions ( δ)( p)yi(y τ) p + pexp( βy) 6 : β > A,v C η

7 is Donsker by Lemma Example 2..8 of Van der Vaart Wellner (996), because ( δ)( p)/( p + pexp( βy)) is bounded. Let F 2η = I (τ, ) (y) : τ τ η, we apply Lemma of Van der Vaart Wellner (996) to show that F 2η is VC-class. Thus the class of functions δθ β(β + θ) I(y > τ) : µ C, τ τ η is Donsker since δθ/β(β + θ) is bounded. It is similar to show that the other classes of functions are also Donsker. Thus the class of functions of F η is VC-class by applying Example 2..7 Theorem 2..6 of Van der Vaart Wellner (996). Finally, by Lemma, ˆµ is consistent. Proof of Theorem 3. We first verify the stochastic equicontinuity condition: n(p n P )[ l µ (ˆµ, ˆν) l µ (µ,ν ) = o p (). (A.3) Let F γ = l µ (µ,ν) l µ (µ,ν ) : µ µ γ, ν ν γ. Simular to the proof of Theorem we can show that F γ is a VC-class. Thus (A.3) follows from Lemma 2 together with Lemma 5. Next, the smoothness Condition 3 holds by (.5) Lemma 5, P n lµ (µ,ν ) converges in distribution to a normal rom variable by the central limit theorem. Thus n ˆµ µ = O p () by Lemma 3. Proof of Theorem. By the consistency of ˆp ˆτ together with Slutsky s theorem the central limit theorem, we can show that (A.) holds with normally distributed Λ with mean zero positive variance. Hence by Lemma, n(ˆµ µ ) is asymptotically normal with mean variance P lµµ (µ,ν ) 2 V. 7

A CHANGE-POINT MODEL FOR SURVIVAL DATA WITH LONG-TERM SURVIVORS

A CHANGE-POINT MODEL FOR SURVIVAL DATA WITH LONG-TERM SURVIVORS Statistica Sinica 19 (2009), 377-390 A CHANGE-POINT MODEL FOR SURVIVAL DATA WITH LONG-TERM SURVIVORS Xiaobing Zhao 1, Xianyi Wu 2 and Xian Zhou 3 1 Jiang Nan University, 2 East China Normal University

More information

STAT Sample Problem: General Asymptotic Results

STAT Sample Problem: General Asymptotic Results STAT331 1-Sample Problem: General Asymptotic Results In this unit we will consider the 1-sample problem and prove the consistency and asymptotic normality of the Nelson-Aalen estimator of the cumulative

More information

Efficiency of Profile/Partial Likelihood in the Cox Model

Efficiency of Profile/Partial Likelihood in the Cox Model Efficiency of Profile/Partial Likelihood in the Cox Model Yuichi Hirose School of Mathematics, Statistics and Operations Research, Victoria University of Wellington, New Zealand Summary. This paper shows

More information

Math 181B Homework 1 Solution

Math 181B Homework 1 Solution Math 181B Homework 1 Solution 1. Write down the likelihood: L(λ = n λ X i e λ X i! (a One-sided test: H 0 : λ = 1 vs H 1 : λ = 0.1 The likelihood ratio: where LR = L(1 L(0.1 = 1 X i e n 1 = λ n X i e nλ

More information

Introduction to Empirical Processes and Semiparametric Inference Lecture 25: Semiparametric Models

Introduction to Empirical Processes and Semiparametric Inference Lecture 25: Semiparametric Models Introduction to Empirical Processes and Semiparametric Inference Lecture 25: Semiparametric Models Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and Operations

More information

Bootstrap - theoretical problems

Bootstrap - theoretical problems Date: January 23th 2006 Bootstrap - theoretical problems This is a new version of the problems. There is an added subproblem in problem 4, problem 6 is completely rewritten, the assumptions in problem

More information

1 Glivenko-Cantelli type theorems

1 Glivenko-Cantelli type theorems STA79 Lecture Spring Semester Glivenko-Cantelli type theorems Given i.i.d. observations X,..., X n with unknown distribution function F (t, consider the empirical (sample CDF ˆF n (t = I [Xi t]. n Then

More information

NETWORK-REGULARIZED HIGH-DIMENSIONAL COX REGRESSION FOR ANALYSIS OF GENOMIC DATA

NETWORK-REGULARIZED HIGH-DIMENSIONAL COX REGRESSION FOR ANALYSIS OF GENOMIC DATA Statistica Sinica 213): Supplement NETWORK-REGULARIZED HIGH-DIMENSIONAL COX REGRESSION FOR ANALYSIS OF GENOMIC DATA Hokeun Sun 1, Wei Lin 2, Rui Feng 2 and Hongzhe Li 2 1 Columbia University and 2 University

More information

Weak convergence and Brownian Motion. (telegram style notes) P.J.C. Spreij

Weak convergence and Brownian Motion. (telegram style notes) P.J.C. Spreij Weak convergence and Brownian Motion (telegram style notes) P.J.C. Spreij this version: December 8, 2006 1 The space C[0, ) In this section we summarize some facts concerning the space C[0, ) of real

More information

Empirical Processes & Survival Analysis. The Functional Delta Method

Empirical Processes & Survival Analysis. The Functional Delta Method STAT/BMI 741 University of Wisconsin-Madison Empirical Processes & Survival Analysis Lecture 3 The Functional Delta Method Lu Mao lmao@biostat.wisc.edu 3-1 Objectives By the end of this lecture, you will

More information

Asymptotic Distributions for the Nelson-Aalen and Kaplan-Meier estimators and for test statistics.

Asymptotic Distributions for the Nelson-Aalen and Kaplan-Meier estimators and for test statistics. Asymptotic Distributions for the Nelson-Aalen and Kaplan-Meier estimators and for test statistics. Dragi Anevski Mathematical Sciences und University November 25, 21 1 Asymptotic distributions for statistical

More information

Introduction to Empirical Processes and Semiparametric Inference Lecture 12: Glivenko-Cantelli and Donsker Results

Introduction to Empirical Processes and Semiparametric Inference Lecture 12: Glivenko-Cantelli and Donsker Results Introduction to Empirical Processes and Semiparametric Inference Lecture 12: Glivenko-Cantelli and Donsker Results Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics

More information

Introduction to Empirical Processes and Semiparametric Inference Lecture 09: Stochastic Convergence, Continued

Introduction to Empirical Processes and Semiparametric Inference Lecture 09: Stochastic Convergence, Continued Introduction to Empirical Processes and Semiparametric Inference Lecture 09: Stochastic Convergence, Continued Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and

More information

Estimation and Inference of Quantile Regression. for Survival Data under Biased Sampling

Estimation and Inference of Quantile Regression. for Survival Data under Biased Sampling Estimation and Inference of Quantile Regression for Survival Data under Biased Sampling Supplementary Materials: Proofs of the Main Results S1 Verification of the weight function v i (t) for the lengthbiased

More information

Introduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued

Introduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued Introduction to Empirical Processes and Semiparametric Inference Lecture 02: Overview Continued Michael R. Kosorok, Ph.D. Professor and Chair of Biostatistics Professor of Statistics and Operations Research

More information

Theory of Statistics.

Theory of Statistics. Theory of Statistics. Homework V February 5, 00. MT 8.7.c When σ is known, ˆµ = X is an unbiased estimator for µ. If you can show that its variance attains the Cramer-Rao lower bound, then no other unbiased

More information

STAT 992 Paper Review: Sure Independence Screening in Generalized Linear Models with NP-Dimensionality J.Fan and R.Song

STAT 992 Paper Review: Sure Independence Screening in Generalized Linear Models with NP-Dimensionality J.Fan and R.Song STAT 992 Paper Review: Sure Independence Screening in Generalized Linear Models with NP-Dimensionality J.Fan and R.Song Presenter: Jiwei Zhao Department of Statistics University of Wisconsin Madison April

More information

Math 152. Rumbos Fall Solutions to Assignment #12

Math 152. Rumbos Fall Solutions to Assignment #12 Math 52. umbos Fall 2009 Solutions to Assignment #2. Suppose that you observe n iid Bernoulli(p) random variables, denoted by X, X 2,..., X n. Find the LT rejection region for the test of H o : p p o versus

More information

Product-limit estimators of the survival function with left or right censored data

Product-limit estimators of the survival function with left or right censored data Product-limit estimators of the survival function with left or right censored data 1 CREST-ENSAI Campus de Ker-Lann Rue Blaise Pascal - BP 37203 35172 Bruz cedex, France (e-mail: patilea@ensai.fr) 2 Institut

More information

M- and Z- theorems; GMM and Empirical Likelihood Wellner; 5/13/98, 1/26/07, 5/08/09, 6/14/2010

M- and Z- theorems; GMM and Empirical Likelihood Wellner; 5/13/98, 1/26/07, 5/08/09, 6/14/2010 M- and Z- theorems; GMM and Empirical Likelihood Wellner; 5/13/98, 1/26/07, 5/08/09, 6/14/2010 Z-theorems: Notation and Context Suppose that Θ R k, and that Ψ n : Θ R k, random maps Ψ : Θ R k, deterministic

More information

Empirical Processes: General Weak Convergence Theory

Empirical Processes: General Weak Convergence Theory Empirical Processes: General Weak Convergence Theory Moulinath Banerjee May 18, 2010 1 Extended Weak Convergence The lack of measurability of the empirical process with respect to the sigma-field generated

More information

Exercises and Answers to Chapter 1

Exercises and Answers to Chapter 1 Exercises and Answers to Chapter The continuous type of random variable X has the following density function: a x, if < x < a, f (x), otherwise. Answer the following questions. () Find a. () Obtain mean

More information

EMPIRICAL ENVELOPE MLE AND LR TESTS. Mai Zhou University of Kentucky

EMPIRICAL ENVELOPE MLE AND LR TESTS. Mai Zhou University of Kentucky EMPIRICAL ENVELOPE MLE AND LR TESTS Mai Zhou University of Kentucky Summary We study in this paper some nonparametric inference problems where the nonparametric maximum likelihood estimator (NPMLE) are

More information

Lecture 2: Uniform Entropy

Lecture 2: Uniform Entropy STAT 583: Advanced Theory of Statistical Inference Spring 218 Lecture 2: Uniform Entropy Lecturer: Fang Han April 16 Disclaimer: These notes have not been subjected to the usual scrutiny reserved for formal

More information

Self-normalized Cramér-Type Large Deviations for Independent Random Variables

Self-normalized Cramér-Type Large Deviations for Independent Random Variables Self-normalized Cramér-Type Large Deviations for Independent Random Variables Qi-Man Shao National University of Singapore and University of Oregon qmshao@darkwing.uoregon.edu 1. Introduction Let X, X

More information

11 Survival Analysis and Empirical Likelihood

11 Survival Analysis and Empirical Likelihood 11 Survival Analysis and Empirical Likelihood The first paper of empirical likelihood is actually about confidence intervals with the Kaplan-Meier estimator (Thomas and Grunkmeier 1979), i.e. deals with

More information

Index Models for Sparsely Sampled Functional Data. Supplementary Material.

Index Models for Sparsely Sampled Functional Data. Supplementary Material. Index Models for Sparsely Sampled Functional Data. Supplementary Material. May 21, 2014 1 Proof of Theorem 2 We will follow the general argument in the proof of Theorem 3 in Li et al. 2010). Write d =

More information

MOMENT CONVERGENCE RATES OF LIL FOR NEGATIVELY ASSOCIATED SEQUENCES

MOMENT CONVERGENCE RATES OF LIL FOR NEGATIVELY ASSOCIATED SEQUENCES J. Korean Math. Soc. 47 1, No., pp. 63 75 DOI 1.4134/JKMS.1.47..63 MOMENT CONVERGENCE RATES OF LIL FOR NEGATIVELY ASSOCIATED SEQUENCES Ke-Ang Fu Li-Hua Hu Abstract. Let X n ; n 1 be a strictly stationary

More information

Efficient Estimation of Censored Linear Regression Model

Efficient Estimation of Censored Linear Regression Model 2 3 4 5 6 7 8 9 2 3 4 5 6 7 8 9 2 2 22 23 24 25 26 27 28 29 3 3 32 33 34 35 36 37 38 39 4 4 42 43 44 45 46 47 48 Biometrika (2), xx, x, pp. 4 C 28 Biometrika Trust Printed in Great Britain Efficient Estimation

More information

Constraints on Solutions to the Normal Equations. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 41

Constraints on Solutions to the Normal Equations. Copyright c 2012 Dan Nettleton (Iowa State University) Statistics / 41 Constraints on Solutions to the Normal Equations Copyright c 2012 Dan Nettleton (Iowa State University) Statistics 611 1 / 41 If rank( n p X) = r < p, there are infinitely many solutions to the NE X Xb

More information

is a Borel subset of S Θ for each c R (Bertsekas and Shreve, 1978, Proposition 7.36) This always holds in practical applications.

is a Borel subset of S Θ for each c R (Bertsekas and Shreve, 1978, Proposition 7.36) This always holds in practical applications. Stat 811 Lecture Notes The Wald Consistency Theorem Charles J. Geyer April 9, 01 1 Analyticity Assumptions Let { f θ : θ Θ } be a family of subprobability densities 1 with respect to a measure µ on a measurable

More information

Hypothesis Testing. Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA

Hypothesis Testing. Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA Hypothesis Testing Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA An Example Mardia et al. (979, p. ) reprint data from Frets (9) giving the length and breadth (in

More information

THE DVORETZKY KIEFER WOLFOWITZ INEQUALITY WITH SHARP CONSTANT: MASSART S 1990 PROOF SEMINAR, SEPT. 28, R. M. Dudley

THE DVORETZKY KIEFER WOLFOWITZ INEQUALITY WITH SHARP CONSTANT: MASSART S 1990 PROOF SEMINAR, SEPT. 28, R. M. Dudley THE DVORETZKY KIEFER WOLFOWITZ INEQUALITY WITH SHARP CONSTANT: MASSART S 1990 PROOF SEMINAR, SEPT. 28, 2011 R. M. Dudley 1 A. Dvoretzky, J. Kiefer, and J. Wolfowitz 1956 proved the Dvoretzky Kiefer Wolfowitz

More information

The International Journal of Biostatistics

The International Journal of Biostatistics The International Journal of Biostatistics Volume 1, Issue 1 2005 Article 3 Score Statistics for Current Status Data: Comparisons with Likelihood Ratio and Wald Statistics Moulinath Banerjee Jon A. Wellner

More information

Stochastic Differential Equations.

Stochastic Differential Equations. Chapter 3 Stochastic Differential Equations. 3.1 Existence and Uniqueness. One of the ways of constructing a Diffusion process is to solve the stochastic differential equation dx(t) = σ(t, x(t)) dβ(t)

More information

Branching Processes II: Convergence of critical branching to Feller s CSB

Branching Processes II: Convergence of critical branching to Feller s CSB Chapter 4 Branching Processes II: Convergence of critical branching to Feller s CSB Figure 4.1: Feller 4.1 Birth and Death Processes 4.1.1 Linear birth and death processes Branching processes can be studied

More information

asymptotic normality of nonparametric M-estimators with applications to hypothesis testing for panel count data

asymptotic normality of nonparametric M-estimators with applications to hypothesis testing for panel count data asymptotic normality of nonparametric M-estimators with applications to hypothesis testing for panel count data Xingqiu Zhao and Ying Zhang The Hong Kong Polytechnic University and Indiana University Abstract:

More information

Score Statistics for Current Status Data: Comparisons with Likelihood Ratio and Wald Statistics

Score Statistics for Current Status Data: Comparisons with Likelihood Ratio and Wald Statistics Score Statistics for Current Status Data: Comparisons with Likelihood Ratio and Wald Statistics Moulinath Banerjee 1 and Jon A. Wellner 2 1 Department of Statistics, Department of Statistics, 439, West

More information

Filtrations, Markov Processes and Martingales. Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition

Filtrations, Markov Processes and Martingales. Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition Filtrations, Markov Processes and Martingales Lectures on Lévy Processes and Stochastic Calculus, Braunschweig, Lecture 3: The Lévy-Itô Decomposition David pplebaum Probability and Statistics Department,

More information

The Central Limit Theorem Under Random Truncation

The Central Limit Theorem Under Random Truncation The Central Limit Theorem Under Random Truncation WINFRIED STUTE and JANE-LING WANG Mathematical Institute, University of Giessen, Arndtstr., D-3539 Giessen, Germany. winfried.stute@math.uni-giessen.de

More information

STAT331 Lebesgue-Stieltjes Integrals, Martingales, Counting Processes

STAT331 Lebesgue-Stieltjes Integrals, Martingales, Counting Processes STAT331 Lebesgue-Stieltjes Integrals, Martingales, Counting Processes This section introduces Lebesgue-Stieltjes integrals, and defines two important stochastic processes: a martingale process and a counting

More information

Goodness-of-fit tests for the cure rate in a mixture cure model

Goodness-of-fit tests for the cure rate in a mixture cure model Biometrika (217), 13, 1, pp. 1 7 Printed in Great Britain Advance Access publication on 31 July 216 Goodness-of-fit tests for the cure rate in a mixture cure model BY U.U. MÜLLER Department of Statistics,

More information

Elementary Probability. Exam Number 38119

Elementary Probability. Exam Number 38119 Elementary Probability Exam Number 38119 2 1. Introduction Consider any experiment whose result is unknown, for example throwing a coin, the daily number of customers in a supermarket or the duration of

More information

Exercises. (a) Prove that m(t) =

Exercises. (a) Prove that m(t) = Exercises 1. Lack of memory. Verify that the exponential distribution has the lack of memory property, that is, if T is exponentially distributed with parameter λ > then so is T t given that T > t for

More information

Partial differential equation for temperature u(x, t) in a heat conducting insulated rod along the x-axis is given by the Heat equation:

Partial differential equation for temperature u(x, t) in a heat conducting insulated rod along the x-axis is given by the Heat equation: Chapter 7 Heat Equation Partial differential equation for temperature u(x, t) in a heat conducting insulated rod along the x-axis is given by the Heat equation: u t = ku x x, x, t > (7.1) Here k is a constant

More information

SDS : Theoretical Statistics

SDS : Theoretical Statistics SDS 384 11: Theoretical Statistics Lecture 1: Introduction Purnamrita Sarkar Department of Statistics and Data Science The University of Texas at Austin https://psarkar.github.io/teaching Manegerial Stuff

More information

ERRATA: Probabilistic Techniques in Analysis

ERRATA: Probabilistic Techniques in Analysis ERRATA: Probabilistic Techniques in Analysis ERRATA 1 Updated April 25, 26 Page 3, line 13. A 1,..., A n are independent if P(A i1 A ij ) = P(A 1 ) P(A ij ) for every subset {i 1,..., i j } of {1,...,

More information

Theoretical Statistics. Lecture 17.

Theoretical Statistics. Lecture 17. Theoretical Statistics. Lecture 17. Peter Bartlett 1. Asymptotic normality of Z-estimators: classical conditions. 2. Asymptotic equicontinuity. 1 Recall: Delta method Theorem: Supposeφ : R k R m is differentiable

More information

Lecture 13: Subsampling vs Bootstrap. Dimitris N. Politis, Joseph P. Romano, Michael Wolf

Lecture 13: Subsampling vs Bootstrap. Dimitris N. Politis, Joseph P. Romano, Michael Wolf Lecture 13: 2011 Bootstrap ) R n x n, θ P)) = τ n ˆθn θ P) Example: ˆθn = X n, τ n = n, θ = EX = µ P) ˆθ = min X n, τ n = n, θ P) = sup{x : F x) 0} ) Define: J n P), the distribution of τ n ˆθ n θ P) under

More information

Estimation of the Bivariate and Marginal Distributions with Censored Data

Estimation of the Bivariate and Marginal Distributions with Censored Data Estimation of the Bivariate and Marginal Distributions with Censored Data Michael Akritas and Ingrid Van Keilegom Penn State University and Eindhoven University of Technology May 22, 2 Abstract Two new

More information

Complete Moment Convergence for Weighted Sums of Negatively Orthant Dependent Random Variables

Complete Moment Convergence for Weighted Sums of Negatively Orthant Dependent Random Variables Filomat 31:5 217, 1195 126 DOI 1.2298/FIL175195W Published by Faculty of Sciences and Mathematics, University of Niš, Serbia Available at: http://www.pmf.ni.ac.rs/filomat Complete Moment Convergence for

More information

Lecture 2. We now introduce some fundamental tools in martingale theory, which are useful in controlling the fluctuation of martingales.

Lecture 2. We now introduce some fundamental tools in martingale theory, which are useful in controlling the fluctuation of martingales. Lecture 2 1 Martingales We now introduce some fundamental tools in martingale theory, which are useful in controlling the fluctuation of martingales. 1.1 Doob s inequality We have the following maximal

More information

Least squares under convex constraint

Least squares under convex constraint Stanford University Questions Let Z be an n-dimensional standard Gaussian random vector. Let µ be a point in R n and let Y = Z + µ. We are interested in estimating µ from the data vector Y, under the assumption

More information

Stability of Stochastic Differential Equations

Stability of Stochastic Differential Equations Lyapunov stability theory for ODEs s Stability of Stochastic Differential Equations Part 1: Introduction Department of Mathematics and Statistics University of Strathclyde Glasgow, G1 1XH December 2010

More information

A Tight Upper Bound on the Second-Order Coding Rate of Parallel Gaussian Channels with Feedback

A Tight Upper Bound on the Second-Order Coding Rate of Parallel Gaussian Channels with Feedback A Tight Upper Bound on the Second-Order Coding Rate of Parallel Gaussian Channels with Feedback Vincent Y. F. Tan (NUS) Joint work with Silas L. Fong (Toronto) 2017 Information Theory Workshop, Kaohsiung,

More information

Lecture 1: Review of Basic Asymptotic Theory

Lecture 1: Review of Basic Asymptotic Theory Lecture 1: Instructor: Department of Economics Stanfor University Prepare by Wenbo Zhou, Renmin University Basic Probability Theory Takeshi Amemiya, Avance Econometrics, 1985, Harvar University Press.

More information

On Asymptotic Normality of the Local Polynomial Regression Estimator with Stochastic Bandwidths 1. Carlos Martins-Filho.

On Asymptotic Normality of the Local Polynomial Regression Estimator with Stochastic Bandwidths 1. Carlos Martins-Filho. On Asymptotic Normality of the Local Polynomial Regression Estimator with Stochastic Bandwidths 1 Carlos Martins-Filho Department of Economics IFPRI University of Colorado 2033 K Street NW Boulder, CO

More information

Chapter 6. Convergence. Probability Theory. Four different convergence concepts. Four different convergence concepts. Convergence in probability

Chapter 6. Convergence. Probability Theory. Four different convergence concepts. Four different convergence concepts. Convergence in probability Probability Theory Chapter 6 Convergence Four different convergence concepts Let X 1, X 2, be a sequence of (usually dependent) random variables Definition 1.1. X n converges almost surely (a.s.), or with

More information

Asymptotic statistics using the Functional Delta Method

Asymptotic statistics using the Functional Delta Method Quantiles, Order Statistics and L-Statsitics TU Kaiserslautern 15. Februar 2015 Motivation Functional The delta method introduced in chapter 3 is an useful technique to turn the weak convergence of random

More information

Chapter 4: Asymptotic Properties of the MLE (Part 2)

Chapter 4: Asymptotic Properties of the MLE (Part 2) Chapter 4: Asymptotic Properties of the MLE (Part 2) Daniel O. Scharfstein 09/24/13 1 / 1 Example Let {(R i, X i ) : i = 1,..., n} be an i.i.d. sample of n random vectors (R, X ). Here R is a response

More information

WEAK CONSISTENCY OF EXTREME VALUE ESTIMATORS IN C[0, 1] BY LAURENS DE HAAN AND TAO LIN Erasmus University Rotterdam and EURANDOM

WEAK CONSISTENCY OF EXTREME VALUE ESTIMATORS IN C[0, 1] BY LAURENS DE HAAN AND TAO LIN Erasmus University Rotterdam and EURANDOM The Annals of Statistics 2003, Vol. 3, No. 6, 996 202 Institute of Mathematical Statistics, 2003 WEAK CONSISTENCY OF EXTREME VALUE ESTIMATORS IN C[0, ] BY LAURENS DE HAAN AND TAO LIN Erasmus University

More information

Verifying Regularity Conditions for Logit-Normal GLMM

Verifying Regularity Conditions for Logit-Normal GLMM Verifying Regularity Conditions for Logit-Normal GLMM Yun Ju Sung Charles J. Geyer January 10, 2006 In this note we verify the conditions of the theorems in Sung and Geyer (submitted) for the Logit-Normal

More information

Selected Exercises on Expectations and Some Probability Inequalities

Selected Exercises on Expectations and Some Probability Inequalities Selected Exercises on Expectations and Some Probability Inequalities # If E(X 2 ) = and E X a > 0, then P( X λa) ( λ) 2 a 2 for 0 < λ

More information

Zdzislaw Brzeźniak. Department of Mathematics University of York. joint works with Mauro Mariani (Roma 1) and Gaurav Dhariwal (York)

Zdzislaw Brzeźniak. Department of Mathematics University of York. joint works with Mauro Mariani (Roma 1) and Gaurav Dhariwal (York) Navier-Stokes equations with constrained L 2 energy of the solution Zdzislaw Brzeźniak Department of Mathematics University of York joint works with Mauro Mariani (Roma 1) and Gaurav Dhariwal (York) Stochastic

More information

END-POINT SAMPLING. Yuan Yao, Wen Yu and Kani Chen. Hong Kong Baptist University, Fudan University and Hong Kong University of Science and Technology

END-POINT SAMPLING. Yuan Yao, Wen Yu and Kani Chen. Hong Kong Baptist University, Fudan University and Hong Kong University of Science and Technology Statistica Sinica 27 (2017), 000-000 415-435 doi:http://dx.doi.org/10.5705/ss.202015.0294 END-POINT SAMPLING Yuan Yao, Wen Yu and Kani Chen Hong Kong Baptist University, Fudan University and Hong Kong

More information

arxiv: v1 [math.st] 7 Sep 2007

arxiv: v1 [math.st] 7 Sep 2007 arxiv:0709.1013v1 [math.st] 7 Sep 2007 IMS Lecture Notes Monograph Series Asymptotics: Particles, Processes and Inverse Problems Vol. 55 (2007) 234 252 c Institute of Mathematical Statistics, 2007 DOI:

More information

SUMMARY OF RESULTS ON PATH SPACES AND CONVERGENCE IN DISTRIBUTION FOR STOCHASTIC PROCESSES

SUMMARY OF RESULTS ON PATH SPACES AND CONVERGENCE IN DISTRIBUTION FOR STOCHASTIC PROCESSES SUMMARY OF RESULTS ON PATH SPACES AND CONVERGENCE IN DISTRIBUTION FOR STOCHASTIC PROCESSES RUTH J. WILLIAMS October 2, 2017 Department of Mathematics, University of California, San Diego, 9500 Gilman Drive,

More information

Survival Analysis: Weeks 2-3. Lu Tian and Richard Olshen Stanford University

Survival Analysis: Weeks 2-3. Lu Tian and Richard Olshen Stanford University Survival Analysis: Weeks 2-3 Lu Tian and Richard Olshen Stanford University 2 Kaplan-Meier(KM) Estimator Nonparametric estimation of the survival function S(t) = pr(t > t) The nonparametric estimation

More information

Two Likelihood-Based Semiparametric Estimation Methods for Panel Count Data with Covariates

Two Likelihood-Based Semiparametric Estimation Methods for Panel Count Data with Covariates Two Likelihood-Based Semiparametric Estimation Methods for Panel Count Data with Covariates Jon A. Wellner 1 and Ying Zhang 2 December 1, 2006 Abstract We consider estimation in a particular semiparametric

More information

1. Stochastic Processes and filtrations

1. Stochastic Processes and filtrations 1. Stochastic Processes and 1. Stoch. pr., A stochastic process (X t ) t T is a collection of random variables on (Ω, F) with values in a measurable space (S, S), i.e., for all t, In our case X t : Ω S

More information

Bahadur representations for bootstrap quantiles 1

Bahadur representations for bootstrap quantiles 1 Bahadur representations for bootstrap quantiles 1 Yijun Zuo Department of Statistics and Probability, Michigan State University East Lansing, MI 48824, USA zuo@msu.edu 1 Research partially supported by

More information

Minimax Estimation of Kernel Mean Embeddings

Minimax Estimation of Kernel Mean Embeddings Minimax Estimation of Kernel Mean Embeddings Bharath K. Sriperumbudur Department of Statistics Pennsylvania State University Gatsby Computational Neuroscience Unit May 4, 2016 Collaborators Dr. Ilya Tolstikhin

More information

Zdzislaw Brzeźniak. Department of Mathematics University of York. joint works with Mauro Mariani (Roma 1) and Gaurav Dhariwal (York)

Zdzislaw Brzeźniak. Department of Mathematics University of York. joint works with Mauro Mariani (Roma 1) and Gaurav Dhariwal (York) Navier-Stokes equations with constrained L 2 energy of the solution Zdzislaw Brzeźniak Department of Mathematics University of York joint works with Mauro Mariani (Roma 1) and Gaurav Dhariwal (York) LMS

More information

UPPER DEVIATIONS FOR SPLIT TIMES OF BRANCHING PROCESSES

UPPER DEVIATIONS FOR SPLIT TIMES OF BRANCHING PROCESSES Applied Probability Trust 7 May 22 UPPER DEVIATIONS FOR SPLIT TIMES OF BRANCHING PROCESSES HAMED AMINI, AND MARC LELARGE, ENS-INRIA Abstract Upper deviation results are obtained for the split time of a

More information

Large sample theory for merged data from multiple sources

Large sample theory for merged data from multiple sources Large sample theory for merged data from multiple sources Takumi Saegusa University of Maryland Division of Statistics August 22 2018 Section 1 Introduction Problem: Data Integration Massive data are collected

More information

Estimation for two-phase designs: semiparametric models and Z theorems

Estimation for two-phase designs: semiparametric models and Z theorems Estimation for two-phase designs:semiparametric models and Z theorems p. 1/27 Estimation for two-phase designs: semiparametric models and Z theorems Jon A. Wellner University of Washington Estimation for

More information

ASYMPTOTIC EQUIVALENCE OF DENSITY ESTIMATION AND GAUSSIAN WHITE NOISE. By Michael Nussbaum Weierstrass Institute, Berlin

ASYMPTOTIC EQUIVALENCE OF DENSITY ESTIMATION AND GAUSSIAN WHITE NOISE. By Michael Nussbaum Weierstrass Institute, Berlin The Annals of Statistics 1996, Vol. 4, No. 6, 399 430 ASYMPTOTIC EQUIVALENCE OF DENSITY ESTIMATION AND GAUSSIAN WHITE NOISE By Michael Nussbaum Weierstrass Institute, Berlin Signal recovery in Gaussian

More information

A Least-Squares Approach to Consistent Information Estimation in Semiparametric Models

A Least-Squares Approach to Consistent Information Estimation in Semiparametric Models A Least-Squares Approach to Consistent Information Estimation in Semiparametric Models Jian Huang Department of Statistics University of Iowa Ying Zhang and Lei Hua Department of Biostatistics University

More information

Bayesian Adaptation. Aad van der Vaart. Vrije Universiteit Amsterdam. aad. Bayesian Adaptation p. 1/4

Bayesian Adaptation. Aad van der Vaart. Vrije Universiteit Amsterdam.  aad. Bayesian Adaptation p. 1/4 Bayesian Adaptation Aad van der Vaart http://www.math.vu.nl/ aad Vrije Universiteit Amsterdam Bayesian Adaptation p. 1/4 Joint work with Jyri Lember Bayesian Adaptation p. 2/4 Adaptation Given a collection

More information

BARTLETT IDENTITIES AND LARGE DEVIATIONS IN LIKELIHOOD THEORY 1. By Per Aslak Mykland University of Chicago

BARTLETT IDENTITIES AND LARGE DEVIATIONS IN LIKELIHOOD THEORY 1. By Per Aslak Mykland University of Chicago The Annals of Statistics 1999, Vol. 27, No. 3, 1105 1117 BARTLETT IDENTITIES AND LARGE DEVIATIONS IN LIKELIHOOD THEORY 1 By Per Aslak Mykland University of Chicago The connection between large and small

More information

Lecture 2: Martingale theory for univariate survival analysis

Lecture 2: Martingale theory for univariate survival analysis Lecture 2: Martingale theory for univariate survival analysis In this lecture T is assumed to be a continuous failure time. A core question in this lecture is how to develop asymptotic properties when

More information

Consistency of bootstrap procedures for the nonparametric assessment of noninferiority with random censorship

Consistency of bootstrap procedures for the nonparametric assessment of noninferiority with random censorship Consistency of bootstrap procedures for the nonparametric assessment of noninferiority with random censorship Gudrun Freitag 1 and Axel Mun Institut für Mathematische Stochasti Georg-August-Universität

More information

arxiv:submit/ [math.st] 6 May 2011

arxiv:submit/ [math.st] 6 May 2011 A Continuous Mapping Theorem for the Smallest Argmax Functional arxiv:submit/0243372 [math.st] 6 May 2011 Emilio Seijo and Bodhisattva Sen Columbia University Abstract This paper introduces a version of

More information

Supplementary Material: Proofs

Supplementary Material: Proofs Supplementary Material: Proofs To prove Teorem 2., we need te following lemma. Lemma A.. Under Assumptions and 2, E(ˆλ (t ) λ( )) = var(ˆλ (t ) λ( )) = f(r)λ(r t )dr, f 2 (r)λ(r t )dr. Proof of Lemma A..

More information

Lecture 17 Brownian motion as a Markov process

Lecture 17 Brownian motion as a Markov process Lecture 17: Brownian motion as a Markov process 1 of 14 Course: Theory of Probability II Term: Spring 2015 Instructor: Gordan Zitkovic Lecture 17 Brownian motion as a Markov process Brownian motion is

More information

SEMIPARAMETRIC LIKELIHOOD RATIO INFERENCE. By S. A. Murphy 1 and A. W. van der Vaart Pennsylvania State University and Free University Amsterdam

SEMIPARAMETRIC LIKELIHOOD RATIO INFERENCE. By S. A. Murphy 1 and A. W. van der Vaart Pennsylvania State University and Free University Amsterdam The Annals of Statistics 1997, Vol. 25, No. 4, 1471 159 SEMIPARAMETRIC LIKELIHOOD RATIO INFERENCE By S. A. Murphy 1 and A. W. van der Vaart Pennsylvania State University and Free University Amsterdam Likelihood

More information

PCA with random noise. Van Ha Vu. Department of Mathematics Yale University

PCA with random noise. Van Ha Vu. Department of Mathematics Yale University PCA with random noise Van Ha Vu Department of Mathematics Yale University An important problem that appears in various areas of applied mathematics (in particular statistics, computer science and numerical

More information

More Empirical Process Theory

More Empirical Process Theory More Empirical Process heory 4.384 ime Series Analysis, Fall 2008 Recitation by Paul Schrimpf Supplementary to lectures given by Anna Mikusheva October 24, 2008 Recitation 8 More Empirical Process heory

More information

On large deviations of sums of independent random variables

On large deviations of sums of independent random variables On large deviations of sums of independent random variables Zhishui Hu 12, Valentin V. Petrov 23 and John Robinson 2 1 Department of Statistics and Finance, University of Science and Technology of China,

More information

Efficient Semiparametric Estimators via Modified Profile Likelihood in Frailty & Accelerated-Failure Models

Efficient Semiparametric Estimators via Modified Profile Likelihood in Frailty & Accelerated-Failure Models NIH Talk, September 03 Efficient Semiparametric Estimators via Modified Profile Likelihood in Frailty & Accelerated-Failure Models Eric Slud, Math Dept, Univ of Maryland Ongoing joint project with Ilia

More information

Interval Estimation for AR(1) and GARCH(1,1) Models

Interval Estimation for AR(1) and GARCH(1,1) Models for AR(1) and GARCH(1,1) Models School of Mathematics Georgia Institute of Technology 2010 This talk is based on the following papers: Ngai Hang Chan, Deyuan Li and (2010). Toward a Unified of Autoregressions.

More information

Empirical likelihood for average derivatives of hazard regression functions

Empirical likelihood for average derivatives of hazard regression functions Metrika (2008 67:93 2 DOI 0.007/s0084-007-024-9 Empirical likelihood for average derivatives of hazard regression functions Xuewen Lu Jie Sun Yongcheng Qi Received: 26 May 2006 / Published online: 9 February

More information

Statistics 581, Problem Set 8 Solutions Wellner; 11/22/2018

Statistics 581, Problem Set 8 Solutions Wellner; 11/22/2018 Statistics 581, Problem Set 8 Solutions Wellner; 11//018 1. (a) Show that if θ n = cn 1/ and T n is the Hodges super-efficient estimator discussed in class, then the sequence n(t n θ n )} is uniformly

More information

Notes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed

Notes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed 18.466 Notes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed 1. MLEs in exponential families Let f(x,θ) for x X and θ Θ be a likelihood function, that is, for present purposes,

More information

Minimum Message Length Analysis of the Behrens Fisher Problem

Minimum Message Length Analysis of the Behrens Fisher Problem Analysis of the Behrens Fisher Problem Enes Makalic and Daniel F Schmidt Centre for MEGA Epidemiology The University of Melbourne Solomonoff 85th Memorial Conference, 2011 Outline Introduction 1 Introduction

More information

Lecture 5 Models and methods for recurrent event data

Lecture 5 Models and methods for recurrent event data Lecture 5 Models and methods for recurrent event data Recurrent and multiple events are commonly encountered in longitudinal studies. In this chapter we consider ordered recurrent and multiple events.

More information

Closest Moment Estimation under General Conditions

Closest Moment Estimation under General Conditions Closest Moment Estimation under General Conditions Chirok Han Victoria University of Wellington New Zealand Robert de Jong Ohio State University U.S.A October, 2003 Abstract This paper considers Closest

More information

Preservation Theorems for Glivenko-Cantelli and Uniform Glivenko-Cantelli Classes

Preservation Theorems for Glivenko-Cantelli and Uniform Glivenko-Cantelli Classes Preservation Theorems for Glivenko-Cantelli and Uniform Glivenko-Cantelli Classes This is page 5 Printer: Opaque this Aad van der Vaart and Jon A. Wellner ABSTRACT We show that the P Glivenko property

More information

A Note on the Central Limit Theorem for a Class of Linear Systems 1

A Note on the Central Limit Theorem for a Class of Linear Systems 1 A Note on the Central Limit Theorem for a Class of Linear Systems 1 Contents Yukio Nagahata Department of Mathematics, Graduate School of Engineering Science Osaka University, Toyonaka 560-8531, Japan.

More information

Fast learning rates for plug-in classifiers under the margin condition

Fast learning rates for plug-in classifiers under the margin condition Fast learning rates for plug-in classifiers under the margin condition Jean-Yves Audibert 1 Alexandre B. Tsybakov 2 1 Certis ParisTech - Ecole des Ponts, France 2 LPMA Université Pierre et Marie Curie,

More information